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Related Applications 

5 The present application claims the benefit of U.S. Provisional Application 

Number 60/179,002 filed on January 28, 2000 and entitled "Method and System to 
_ Support Interoperable Network Elements in an Optical Network". 
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sj Field Of The Invention 

H This invention generally relates to the operation and management of 

8 s * 

10W telecommunications network and more specifically to the operation and management 
• y of network elements within the public switched telephone network. 

2 : 

jjj Background 

y A network may be considered to be a collection of network elements that 

«■ 

(3 communicate with each other over physical links or paths. The network elements 

m 

15 can be routers, switches, multiplexer/demultiplexers, etc. The physical links or paths 
can comprise copper cable, coaxial cable, or fiber cable. In addition to the network 
elements and links, the network also comprises a group of network management 
systems that perform the task of operating, administering, managing, and 
provisioning the network elements. From the view of the network management 

20 system the links or paths and network elements form a network topology which 
includes a hierarchical structure. As such, when new services are requested 
network management systems are used to modify the settings in the appropriate 
network elements, establish new links, and update the network topology. 
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In order to adequately manage a network, a network management system 
(NMS), such as a provisioning system, needs to have an accurate view of the 
network topology in a database. The network topology database typically contains 
objects representing specific network elements (NEs), links, and their connectivity. 
5 When the configuration of the real network changes, the network topology database 
must be changed in order to accurately track it. 

Currently, the method for updating the network topology database is largely 
manual, particularly in the case of optical networking physical layer equipment (e.g., 
^ Wavelength Division Multiplex (WDM), Synchronous Optical NETwork (SONET), 

io'S network elements) and links. For example, if a new SONET network element is 

""4 

\p& installed or attached to the network, associated network topology equipment has to 

M 

!M be manually entered into the associated network management system. If there is a 

hi 

]^ fiber link change, this too needs to be manually updated into the network 

-Ft 

J(| management system; and so on. Because the process is manual, the update 

IT I " Milt 

i5j« s system is labor-intensive and prone to error. It is common to have the network 
management system view of the network topology either lagging behind the real 
network, or running ahead of it, or being just incorrect. Further, the traditional 
process of introducing a new network element to a network or establishing a new 
path may take weeks, even months. In addition, entering physical link information 

20 into the topology database presents several other problems affecting accuracy. 

Network element auto-discovery is currently available for network elements 
having Internet Protocol (IP) layer functionality. Specifically, as part of its protocol IP 
provides auto-discovery functionality which allows an IP router, for example, to 
gather the IP address of each IP layer equipment that is attached to that router. 

25 More specifically, the Internet protocol suite provides highly structured tools that can 
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be used to support network auto-discovery, most notably: the IP address, which 
uniquely identifies hosts, routers, ports, and networks; utilities such as ping; and 
Signaling Network Management Protocol (SNMP). IP auto-discovery functionality 
therefore allows a network management system operating in the IP domain to 
5 construct the topology of the IP network by simply communicating with the network 
elements in the network. 

Equivalent auto-discovery functionality is not available for optical equipment 
operating at the physical layer. Thus, a network management system cannot 
automatically discover which physical link connects two network elements and which 

I?* 

HO 

lo^/j ports are involved in the connection. Furthermore, there are multiple interrelated 

iji circuits at multiple protocol domains or layers: Wavelength Division Multiplex (WDM), 

m 

l& Synchronous Optical NETwork (SONET), Asynchronous Transfer Mode (ATM), 
1 Internet Protocol (IP) to name a few. Moreover, each protocol domain (i.e., each 
\[\ layer of the protocol stack) is typically managed by a separate network management 
is p system within a different network management sector. Finally, network management 
systems do not talk to each other. 

To further illustrate the prior art limitations discussed above we refer to an 
illustrative network 100 as is shown in FIG. 1. FIG.1 depicts a SONET network 110 
that is used as higher rate transport path between IP routers 112 and 113. The IP 
20 routers in essence use the SONET network 1 10 to establish IP link 117. The figure 
also illustrates each domain being managed by different network management 
systems. Specifically, IP-Layer network management system 130 is only able to 
see the IP routers 112 and 113 in the network. In contrast, optical layer network 
management system 140 is only able to see the optical layer network elements 1 19. 
25 The optical layer network elements 119 are invisible to the IP layer network 
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management system and the IP routers are invisible to the optical layer network 
management system 140. Thus, the result of an auto-discovery probe from network 
management system 130 would show only IP router 112 connected to IP router 113. 
In short, the entire SONET network 110 appears to the IP-Layer network 
5 management system as a single abstract IP link 117. Clearly, to be able to manage 
a multiple-protocol domain network, the network management system 130 should be 
able to find all the network elements by using auto-discovery. 

Of utility then is a method and system that allows network management 
P functionality across multiple network protocol domains. 

10 | Summary 

H Our invention is a method and system for automatically discovering optical 

layer network elements. 

H 

Z G 
*i jj * 

In accordance with an aspect of our invention network elements comprising a 
\p network are each assigned a unique electronic serial number. In addition each port 

Si! 

-. rsr 

15 14 on a network element is uniquely defined. The unique port identifier and electronic 

P 

H serial number are then used by a point-to-point physical protocol to discover 
neighboring network elements. Each time a network element is connected to 
another network element via a physical link, each network element is able to 
determine the electronic model number, serial number and port identifier for the 

20 network element (NE) at the far end of the link. The network element subsequently 
sends this information to the network management system (NMS). The network 
management system is then able to use the information contained in the messages 
to construct a topology of the network. 

Because our invention advantageously operates at the lowest layer all the 

25 network elements comprising a network are automatically discovered. Specifically, 
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in accordance with an aspect of our invention optical layer network elements as well 
as higher-layer network elements are automatically discovered. As such, a network 
management system implemented in accordance with our invention can acquire a 
more complete view of the entire network topology. 
5 In accordance with another aspect of our invention network operators not 

desiring a complete view of the network topology may appropriately filter the 
discovered network topology. 

Our invention operates autonomously and may be initiated by the network 
^ management system or the network elements within a network. The autonomous 
10 y nature of our invention overcomes the prior art shortcomings by allowing for almost 
l& instantaneous updates of a network topology in response to the addition of a new 

iti 

5^ network element or the addition or turning up a new link. 

p Brief Description of the Drawings 

FIG. 1 depicts prior art network management systems and subject network 

y 

15(4 elements; 
H FIG. 2 is a high level illustration of our invention; 

FIG. 3 illustratively depicts our method for uniquely identifying a network 
element in accordance with an aspect of our invention;; 

FIG. 4A depicts the format of a request packet used accordance with an 
20 aspect of our invention; 

FIG. 4B depicts the format of a response packet used in accordance with an 
aspect of our invention; 

FIG. 5A depicts the method steps of an network management system initiated 
update in accordance with an aspect of our invention; and 
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FIG. 6 illustrates an exemplary network operating in accordance with our 



invention. 



Detailed Description 



Turning to FIG. 2 there is depicted a high level view of an exemplary network 
5 in accordance with our invention. In FIG. 2 a first network element (NE) 210 is 
communicating with a second network element 220 over a link 225. Link 225 is 
preferably an optical link. As will become clearer below, the first and second network 
elements may be in different domains; for example, network element 210 may be an 
IP router or host whereas network element 220 may be a SONET Add Drop 



lOkQ Multiplexer. Both network elements 210 and 220 are connected via links 228 and 



■'-4 



229 to a network management system 230. The connections 228 and 229 is done 

I*. 

iu using an Operating System/Network Element (OS/NE) protocol such as SNMP for IP 



domain network elements and connection 228 TL-1 for SONET equipment. In 



l Cm ; 



jjjj addition, the network management system 230 is connected either directly or 

15H indirectly to each network element 210 and 220 via a data network 233. Although 

P 

H we show each network element connected to in FIG. 2 those skilled in art will 
recognize that a network management system is usually able to indirectly 
communicate with several other network elements through the network element, so 
called gateway, that the network management system is directly connected to. 

20 Each network element is seen exchanging, in accordance with our 

nomenclature, a hand-shake protocol 240. By use of the hand-shake protocol 240, 
along with the other aspects of our invention described below in more detail, our 
invention allows all the network elements comprising a network to be automatically 
discovered which in turn allows the network management system 230 to develop a 

25 complete view of the topology of the network across many network domains. 
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!n addition to the hand-shake protocol 240 mentioned above, other aspects of 
our invention include a method for uniquely identifying a network element and an 
optical port on the network element and a method wherein each network element, 
either responsive to a request from a network management station or a self 
5 instantiated command/request, provides its identification, the identification of each 
optical port on the subject network element, and for each port connected to a link, 
the identification of the port at the far end of the fiber (the far end network element 
identification and the far end port identification), 
p In addition, each network element in FIG. 2 has functionality for encoding of 

io 1 J an electronic model and serial number in accordance with an aspect of our invention 
I* as is illustrated by functional block 251 . Block 251 is connected to a processor 252. 

l* Processor 252 is used in executing handshake protocol 240. Processor 252 also 

m 

* n has as another input functional block 255. Block 255 is a physical layer auto- 

m 

lii discovery functional module that can be initiated by network management system 

u - 

i5p 230 or the network element in which it resides. 

Turning to FIG. 3 there is illustrated our method for uniquely identifying a 
network element in a vendor or supplier neutral manner. At block 310 a network 
element is assigned two values: a network element model number and a network 
element serial number. These values are intended to uniquely identify each network 

20 element in much the same way that each cellular phone is uniquely identified. As 
such, we refer to these values as a network element's electronic serial number. 



At block 320 the assigned model number and serial number are electronically 
encoded on the network element. The model number and serial may be 
advantageously represented by a character string in the network element. This step 
25 requires each network element to possess the intelligence to realize or know of its 
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own electronic serial number. Although currently each network element in the Public 
Switched Telephone Network (PSTN) is assigned a Common Language Equipment 
Identification (CLEI) codes and a Common Language Location Identification (CLLI) 
codes, those codes or values are not presently electronically encoded in the 

5 associated network element. More importantly, the current manual process of 
updating the network topology database is precisely the process of associating the 
proper CLEI and CLLI code with proper links in the network. 

Nonetheless, already existing values or codes, such as CLEI or CLLI code, 
m can be used as an electronic serial number as long as the equipment possess the 

iom intelligence to know or recognize its own serial number and the serial number of 



t. 3 
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other equipment. In short, the prior art is devoid of network elements that have the 



functionality that allows encoding of an electronic serial number for the purpose of 
our inventive concept. This functionality is illustrated in FIG. 2 as a software module 



251 that runs on a processor 252. 



Ill 

G - 

iU 

isp In addition to each network element having an electronic serial number each 



port on a network element, in accordance with another aspect of our invention, is 
assigned a unique port identifier, block 321 . Normally, every network element has its 
own manufacturer's syntax for identifying each port on the network element. In 
addition, each port on the network element is uniquely identified within this syntax. 
20 As such, the manufacturer's unique identifier may be used in accordance with our 
invention. 

At block 330 each network element is represented in the network 
management system 230 (of FIG. 2) with an object that has the two values that 
comprise the electronic serial number. The network management system requires 
25 knowledge of the electronic serial number so that it (the network management 
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system) it is able to uniquely identify each network element network element within a 
network. The object representing the network element in the network management 
system can be loaded with the electronic serial number either automatically or 
manually. Automatic loading is more advantageous than manual loading since it 
removes the human error element from the process. Automatic loading would take 
place the first time the network element is installed in the network and connected to 
the network management system by having the network element autonomously 
inform the network management system of its presence. Manual loading of the 
network management system is not as advantageous as automatic loading, 
nevertheless manually loading the network element serial number in accordance 
with our invention represents a significant advance over the current practice. This is 
the case because only the electronic serial number of the network element needs to 
be loaded. In accordance with our invention each network element automatically 
discovers all the other network elements it is connected to and provides this 
information to an network management system, more precisely in the network 
topology database. 

With each network element having an electronic serial number and each port 
on the network element being uniquely identified neighboring network elements then 
automatically communicate their respective connectivity information to each other as 
is shown at block 340 of FIG. 3. This communication is effected by way of a physical 
or optical layer auto-discovery function residing in each network element 
(represented as block 255 of FIG. 2). As previously discussed, while IP layer auto- 
discovery presently exists at the IP layer for equipment in the IP domain, IP layer 
auto-discovery is, however, vendor specific and done at the IP layer. Therefore, 
equipment operating at lower layers in the OSI stack are invisible using vendor 
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specific auto-discovery tools currently available. In contrast, the physical layer is the 
lowest layer in the OSI stack thus auto-discovery at the physical layer illuminates 
equipment operating at the other higher layers in the stack - more importantly in the 
network. 

The communication that takes place between neighboring network elements 
can be accomplished by a point-to-point protocol whereby a network element 
queries its neighbor across a link, for example an optical link, for configuration 
information at the far end. The configuration information requested by each network 
element of its neighbor comprises the subject network element serial number and 



io%! the unique identifier of the far-end network element's port that connected to the 



-S3 



l& requesting network element. 



?^ In accordance with another aspect of the present invention we developed a 

Far-End Protocol for communicating connectivity information or network element 



!1 JfL T 



data between neighboring network elements. In accordance with our Far-End 



m 

3"- 



I5j3 protocol communications between a network element and its neighbor across a link 



is via 256 byte packets. In the bit stream in each direction the packets are 
demarcated by using standard Zero Bit Insertion/Deletion (ZBID) flags, such as is 
done in the HDLC protocol. Each communication transaction consists of a request 
packet and a response packet. 

20 The format of our Request Packet 401 is shown in FIG. 4A. As FIG. 4A 

shows, the request packet comprise a PacketProtocolldentifier 408, a 
SequenceNumber 409, and Padding 410. The Packet Protocol Identifier 408 is a 
fixed ASCII character string to indicate that the packet is a far-end protocol request 
packet. It is a fixed ASCII strings that reads FarEndProtocolRequest. The sequence 

25 number 409 is an integer that uniquely identifies a request-response sequence. It is 
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incremented by the requesting network element for each new request-response 
transaction. After reaching the maximum, this integer wraps around. We allocated 
four bytes for the sequence number. The padding consists of ASCII blanks to make 
the packet 256 bytes long. For clarity we include Table 1 below which contains a 
5 summary of the function and format of the request packet. 



Table 1 



Field 


Function 


Format 


PacketProtocol 
Identifier 


This is just a fixed ASCII character string to indicate 
that this is a Far End Protocol request packet. It is a 
fixed ASCII string which reads: FarEndProtocolRequest 


FarEndProtocol 
Request (20 bytes) 


SequenceNumber 


This number uniquely identifies a request-response 
sequence. It is incremented by the Requesting NE for 
each new request-response transaction. After reaching 
the maximum, this integer wraps around. 


Integer (4 bytes). 


Padding 


Padding to make the packet 256 bytes 


ASCII blanks (23 1 
bytes) 



j*J In FIG. 4B we show the format of our response packet 451 which comprises a 

H . I 

[** PacketProtocol Identifier 458, a SequenceNumber 459, FarEndElectronicModel 

lojfj Number 471, FarEndElectronicSerial Number 472, FarEndPortldentifier 473, and 

hi 

I* Padding 475. Packet Protocol Identifier 458 is a fixed ASCII character string to 

4 ***** 

!<* indicate that this is a Far End Protocol response packet. Sequence Number 459 is 
the same 4-byte Sequence Number sent by the request packet to which this is a 
response. Far End Electronic Model Number 471 is an ASCII-encoded electronic 

is model number of the network element product at the far-end. ASCII-encoded 
Electronic Serial Number of the network element product at the far-end. Far End 
Electronic Serial Number 472 is an ASCII-encoded electronic serial number of the 
network element product at the far-end. Far End Port Identifier 473 is a port number, 
using manufacturer's syntax, which uniquely identifies the port at the far end. 

20 Padding 475 is a 38 byte ASCII blank string to make the packet 256 byte in length. 



- n - 



APP 1237 



For clarity we included Table 2 below which summarizes the fields, functionality, and 



format of a response packet. 



Table 2 



Field 


Comment 


Format 


PacketProtocol 
Identifier 


Fixed ASCII character string to indicate that this is a Far 
End Protocol response packet. 


FarEndProtocol 
Response 


SequenceNumber 


The same 4-byte SequenceNumber sent by the Request 

J A. J 1 

Packet to which this is a response. 


Integer (4 bytes). 


FarEndElectronic 
ModelNumber 


ASCII-encoded Electronic Model Number of the NE 
product at the far-end. 


Char (64 bytes). 
Left-justified, 
padded with 
blanks. 


FarEndElectroni c 
SerialNumber 


ASCII-encoded Electronic Serial Number of the NE 
product at the far-end. 


Char (64 bytes) 
left-justified, 
padded with 
blanks. 


FarEndPort Identifier 


Port number, using manufacturer's syntax, which 
uniquely identifies the port at the far end. 


Char (64 bytes) 
left-justified, 
padded with 
blanks. 


Padding 


Padding to make the packet 256 bytes 


ASCII blanks (38 
bytes) 



'■4 

u 

W 

5 * Where a network element does not respond in a timely manner to a request packet a 

**** 

J* | fixed time-out of approximately one minute is allowed by the requesting network 

all 
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element. We chose one minute for our timeout timer because our protocol is for 
communication between neighboring network elements. Nonetheless, a timeout 
time of less than or more than minute may be appropriate depending on the 
10 circumstances. In addition, in accordance with this aspect of our invention for a 
response packet to be accepted as valid by the requesting network element, the 
packet must arrive in one minute and must have a matching sequence number. 
Otherwise the packet is discarded. 

With the network elements able to exchange connectivity information among 
is themselves, that connectivity information may then be communicated to the network 
management system as is shown at block 350 of FIG. 3. There are two methods for 

updating the network topology information in the network management system. One 
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method is network management system-initiated and the other is network element 
initiated. Both types of updates function concurrently. The network element initiated 
update ensures that the network-topology information in the network management 
system is always up-to-date. The network element initiated update is event-triggered, 
5 e.g., when a fiber link is connected into a port of the network element. The network 
management system-initiated update is useful for establishing an initial population 
for the network management system database, and periodic re-synching with the 
real network topology. 

We now turn to FIGS. 5A and 5B to describe network management system- 

'■iO 

io "i initiated and network element initiated updates of network topology, respectively. 



553 



i 



In FIG. 5A, the network management system initiated update begins at block 



1~ 510 with a network management system requesting a configuration update from 



3 _ each network elements it knows of. As previously discussed the network 

fi W 

j*| management system need not be directly connected to each network element that it 
15 jji knows of. As a practical matter, the network management system need only be 

pi • 



connected to a gateway network element within each domain and use the gateway 
network element to communicate to all other network elements within that domain. 
Further, the protocol for communication between the network management system 
and the network elements can be any of the standard Operating System/Network 
20 Element (OS/NE) protocol such as, for example, SNMP, TL/1, CORBA, or a 
proprietary protocol. 

On receiving a configuration update request the network element uses a 
point-to-point protocol, such as our far-end protocol, to request connectivity 
information of all its neighbors, block 515. Ports that are not active, i.e., not 
25 connected will result in a null response. Ports that are connected respond with the 
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far-end model number and serial number and the far end port identifier, block 520. 
The network element then sends the network management system a block of 
information about itself, block 525. The information then includes the network 
element model number, network element serial number, and for each connected port 
5 on the network element the port identifier, far end network element model number, 
far end network element serial number, and the far end network element port 
identifier. If a port is a null then a null packet is sent for that port. 

We now turn to FIG. 5B to discuss the method for a process initiated update. 
At block 570 the method begins with a trigger event. The following events can serve 
io^ as triggers: the network element is powered up or a link is connected or 



t ** 
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disconnected. Once the trigger event occurs, the network element transmits a 



I** message to the network management system to inform the network management 
system that it will be updating its configuration, block 572. The network element then 



uses the Far End Protocol to gather a block of information about itself, block 575. 

it s- 

15 ^ The block of information includes the same information gathered at block 525 in FIG. 
5A. Specifically, the information includes the network element model number, 
network element serial number, and for each connected port on the network element 
the port identifier, far end network element model number, far end network element 
serial number, and the far end network element port identifier. If a port is a null then 

20 the null packet is sent for that port. The network element then sends the block of 
information to the network management system, block 580 

By using the methods described in FIG. 5A and FIG. 5B a network 
management system acquires more than sufficient information to determine the 
entire physical layer connectivity of the network. A network management system 
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operating in accordance with our invention is therefore able to automatically keep 
current with the real network topology as the network evolves. 

To further clarify our invention, we turn to FIG. 6 which depicts an exemplary 
network designed and operating in accordance with the aspects of our invention 
5 described above. The network of FIG. 6 is merely illustrative and is used only to 
further explain the benefits and advantages of our invention. FIG. 6 illustrates a 
network management system 610 communicating with ATM domain, SONET 
domain, and IP domain network elements. In particular, ATM switch 615 is 
connected to SONET network element 620, routers 622 and 624, and network 

9 3 

io!-1 management module 610. SONET network element 620 is connected to SONET 

"?S 

i, s 
>- I 

jji network element 628 and network management module 610. SONET network 

W 

\* element 628 is connected to router 629. Router 629 is also connected to network 
W 

* management system 610. In addition, router 629, network elements 620 and 628, 

w ■ ■ K 

J r j and switch 615 each include auto-discovery functional module 255, processor 252, 
is IZ and electronic serial number module 251 . 

In addition to communicating with switches, routers and other network 
elements comprising a network, network management 610 module optionally 
includes links to downstream fault management, performance management and 
other administrative systems 650. The information stored in network management 
20 system 610 can be used by these systems 650 to perform their respective functions. 

In accordance with our invention, the network management function 610 has 
a topology view of the network that preserves the relationships between the circuits 
and ports at different layers. Including the relationship between circuit and ports at 
different layers represents a significant advance over the prior art. This integrated 
25 view of the network topology is extremely useful, not only for provisioning and 
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assignments, but also for fault management and performance management. In 
accordance with our invention, to add a new network element to the network, a 
network support person wires up the network element as desired. The network 
management function 610 instantly gets a current topology view of the network, 
5 including the new network element. The new network element at the instant it is 
connected to the existing network is ready for carrying service and can be monitored 
for performance. If, subsequently, physical links are changed or re-assigned, the 

o 

network management module reflects the changes in topology within any domain. In 
m accordance with our invention when a network element vendor product hits the 
io Q market, the software changes required in network management functionality are 

|d* minimal, or non-existent. 

W 

!<* In particular, network management system 610 by being connecting to ATM 

W 

|L switch 615, SONET/WDM network element 620, and router 629 can autonomously 

i! ' 8 
- -tf 

j'{ construct a more accurate network topology. ATM switch 615 would be able to gain 

P ^ 

15 ' ^ knowledge of all its neighboring network elements 620, 622, and 624 by executing 

; : si? 
u , 

our far end protocol over the OC-3 and T1 links to each of these respective network 
elements. SONET/WDM 220 network element would be able to relay connectivity 
information about its neighboring network elements 215 and 228. In addition, router 
229 would indicate its connection to network element 228. As previously discussed, 
20 the network elements directly connected to the network management system would 
also serve as gateways to not only it neighbors but to all the subtending network 
elements that form part of that domain's network. For example, by being connected 
to SONET/WDM network element 620 the network management system would be 
able to construct the entire optical network 666 connected to network element 620. 
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The above description has been presented only to illustrate and describe the 
invention. It is not intended to be exhaustive or to limit the invention to any precise 
form disclosed. Many modifications and variations are possible in light of the above 
teaching. The applications described were chosen and described in order to best 
5 explain the principles of the invention and its practical application to enable others 
skilled in the art to best utilize the invention on various applications and with various 
modifications as are suited to the particular use contemplated. 
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